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Are there traps in quantum control landscapes? 
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There has been great interest in recent years in quantum control landscapes. Given 
an objective J that depends on a control field e the dynamical landscape is defined 
by the properties of the Hessian 5^J/(5e^ at the critical points dJ/Ss = 0. We show 
that contrary to recent claims in the literature the dynamical control landscape 
can exhibit trapping behavior due to the existence of special critical points and 
illustrate this finding with an example of a 3-level A-system. This observation can 
have profound implications for both theoretical and experimental quantum control 
studies. 
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Quantum control aims to manipulate the dynamics of physical processes on the atomic 
and molecular scale. It is a rapidly growing held of science with numerous applications 
ranging from selective laser-induced atomic or molecular excitations to high harmonic gen¬ 
eration, quantum computing and quantum information, and control of chemical reactions 
by specially tailored laser pulses, etc. [l|-5|. 

Generally quantum control problems can be formulated as the maximization of an ob¬ 
jective function J{e) by a suitable optimal control e. A wide variety of quantum control 
phenomena, selective bond breaking, etc. can be described by control objectives of the 
form J{e) = Ti\Ue{T)pQUl{T)0], where O is an operator describing the target, po is the 
initial density matrix and Ue{T) is the evolution operator under the action of the control £ 
satisfying the equation 


dUsjt) 

dt 


= -i[Ho - ij.e{t)]Ue{t ), 


( 1 ) 


where Ho is the free system Hamiltonian and p is the dipole moment. 

The objective J = J[e\ as a function of the control £ dehnes the landscape of the control 
problem. The structure of the landscape determines the complexity of the underlying control 
problem. Particularly important features of a control landscape are traps — local maxima 
of J{s). Traps can have a profound influence on both theoretical and experimental quantum 
control studies — they can slow down or even prevent hnding globally optimal controls and 
can lead to erroneous physical conclusions about optimal processes and robustness. We 
show that contrary to recent claims in the literature 


11| the dynamical control landscape 


can exhibit trapping behavior due to the existence of special critical points and illustrate 
this hnding with an example of a 3-level A-system. This observation can have profound 
implications for both theoretical and experimental quantum control studies. 

To understand why traps are signihcant, consider the generic problem of hnding a globally 
optimal control such that J{e^) = J^ax = maxJ(£). Unless the system is extremely 
simple, numerical or laboratory optimization algorithms generally need to be employed. 
The prevailing theoretical methods start from an initial trial control £ and use gradient 
and Hessian (hrst- and second-order) information to explore the neighborhood for a control 
with better performance. This new control is then used as a new starting point and the 
process is iterated. Experimentally, evolutionary algorithms are commonly used. While 
these algorithms are not strictly hrst- or second-order, each new generation of controls still 
has a propensity to explore the neighborhood of the previous generation. If the control 
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FIG. 1. Left: Cartoon of a landscape without traps (local maxima). All peaks are of the same 
height and thus all of them are global maxima. From Science 303 , 1998 (2004). Reprinted with 
permission from AAAS. Right: Cartoon of a landscape with traps. The landscape has one highest 
peak representing the global maximum and several peaks of lower height representing multiple local 
maxima. Both landscapes are plotted for two control variables, Xj and Xk, representing the control 
field e{t) at two different time moments. The actual number of variables in practical applications 
may be several hundreds. A local search over the landscape on the left will eventually reach a 
global maximum, due to the absence of traps. However, a local search over the landscape on the 
right will most likely find a trap, ending the search process without ever finding the highest peak. 


landscape has traps then first- and second-order algorithms, which effectively are providing 
only a local search over this landscape, can be prevented from reaching a globally optimal 
solntion £*. Thns, the existence or absence of traps is a signihcant characteristic for any 
control landscape. Fig. [T] shows landscapes with and withont traps. 


The analysis of qnantnm control landscapes was performed in a series of pioneering 
works BQ . Extrema of trace functions over nnitary and orthogonal gronps were also 


stndied in a different context 112 


, Il3| and in the context of qnantnm control |14J . 


m. The 


analysis in conclnded the absence of traps. In snbseqnent work it was established that 

this conclnsion was nnder the implicit assnmption that the Jacobian SU^/Se has fnll rank at 
any point. Althongh this assnmption was shown to be violated at times 20(], is was believed 


to be generally applicable. Recently, a particnlar example of a trap was constrncted 


2l|. 


The present paper signihcantly advances the field by showing that second order traps — 
points at which the Hessian H = 5‘^J/5e^ is negative semi-dehnite — exist in a wide class 


of qnantnm control systems 


22 |. 
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We begin our discussion by distinguishing between the dynamic and the kinematic control 
landscapes. Until now we have been discussing the functional J[s\, but one may also consider 
the simpler functional J\U], where the dependence of f/ on e is suppressed: 


MU] = TippoU^O] 


( 2 ) 


Equation (j2]) dehnes the kinematic control landscape. A dynamic critical point (DCP) is 
dehned by V J{e) = 6J{e)/6e = 0 whereas a kinematic critical point (KCP) is dehned by 
VJk(U) = 5J{U)/5U = 0, where V denotes gradient. Dynamic and kinematic traps are 
subopimal maxima for J[e\ and Jk\U]i respectively. 

Assuming complete controllability, i.e. that t/ in ([2]) can be any unitary operator, the 
kinematic control landscape is known to be free of traps: all critical points of Jk[U] are 
either global maxima and minima, or saddles [l6|. This result implies that the dynamic 
control landscape will be t rap -free if one additionally assumes that the Jacobian SUs(T)/6e 
has full rank at any e IT], ll8|]. Indeed, by the chain rule, 

6J{e) _ 6JK[Ue{T)]6U,{T) 

6e{t) 6Ue{T) 6e{t) 

and hence under the full rank condition all DCP are at KCP and have exactly the same 


critical point structure as the corresponding KCP 


19|. 


Our Erst result concerns the inequivalence of critical point structures. To hnd the con¬ 
dition for a KCP of (12]) we take any inhnitesimal variation of U in the form U ^ U' = 

n 

U{1 + 6U) [l6j. Unitarity of U' up to the hrst order in 6U implies = —6U, i.e. 
SU is anti-Hermitian, and hence the variation of the objective Jk with respect to U is 
6Jk = MU'] - MU] = Tt{6U[po,Ot]} + o(||(5f/|l), where Ot = WOU. If f/ is a criti¬ 
cal point for Jk[U], then the condition SJk = 0 needs to hold for any anti-Hermitian SU, 
implying that 

[po, Ot] = 0 . (3) 

Equation dSj) is the condition for a KCP. All U satisfying the condition ([3|) were shown 
to be either global maxima, minima, or saddles 1^, and therefore second order traps do 
not exist for kinematic control landscapes. Dynamical critical control helds that violate ([3]) 
were shown to exist for the problem of optimal population transfer between two pure states 
of a quantum systems 2]|. We have been able to generalize this finding by showing that 
such helds exist not only for optimal population transfer between two pure states, but for 
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maximizing the expectation value of a more general class of observables. The proof is given 
in Section 3 of the Appendix. This inequivalence of the critical points in the dynamic and 
kinematic landscapes is an indication of the breakdown of the full rank assumption. 

We now turn to our main result. For a general class of systems there exist dynamical 
critical controls {[pq^Ot] = 0) that are second order traps due to the violation of the full 
rank assumption. In particular, second order traps appear in the dynamical control land¬ 
scape whenever the dipole moment satishes pij = 0 for some i ^ j (i.e. if a direct transition 
between some pair of levels is forbidden). In this case there exists an initial density matrix 
and a target operator such that e{t) = 0 is a second order trap. (Note that the condition 
Pij = 0 can be consistent with the assumption of complete controllability of the system pro¬ 
vided that the levels i and j are connected indirectly through other states.) More generally, 
a control e{t) = Sq is a second order dynamical trap if in terms of the spectral decomposition 
Hq = Hq — peo = Yh=i hi\i){i\ the initial density matrix and target operator have the form 
Po = \k){k\ and O = SILi where 1 < k < n and Ai > A 2 > ... > A„,, and the 

dipole moment satishes {i\p\k) = 0 for all i < k. (Again, the condition that {i\p\k) = 0 for 
any i < k < n can be consistent with the controllability assumption if the dipole moment 
connects the state \k) with all states \i) for i < k through other states.) To prove this 
hnding, we explicitly compute the Hessian and show that it is negative semidehnite under 
the above conditions; the details of the proof are given in Section 2 of the Appendix. 

The simplest example of such a second order trap appears in the problem of maximizing 
the expectation of an operator O = with A 2 > Ai > A 3 for a three-level A-atom 

initially in the state po = |1)(1| (Figure [2]). The dipole moment for A-atom satishes pi 2 = 0, 
consistent with the controllability assumption if pis 7 ^ 0 and P 23 7 ^ 0. Globally optimal 
control helds steer | 1 ) completely into | 2 ) producing the global maximum of the objective 
with value Jmax = A 2 . The control held e{t) = 0 produces a second order trap with the 
objective value J = Ai < Jmax- 

In conclusion, we have established that second order traps in quantum control landscapes 
exist in a wide range of quantum systems. More research will be required to establish if these 
points are true traps, but for the local search algorithms currently in use second order traps 
pose virtually all the same numerical and experimental difficulties as true traps. Moreover, 
since the present work establishes that the full rank assumption is violated for a wide class 
of quantum systems, the previous claims of the absence of traps, which were based on this 
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FIG. 2. The simplest example of a quantum system possessing a second order trap is a 3-level A- 
system initially in the ground state. The control field e(t) = 0 is a second order trap for maximizing 
expectation of any target operator of the form O = with A 2 > Ai > A 3 . 

assumption, have to be completely rethought. 

This work was supported by the EU Marie Curie Network EMALI, the Minerva Foun¬ 
dation and the NSF under Grant No. PHY05-51164, KITE preprint number: NSF-KITP- 
11-031. This research is made possible by the historic generosity of the Harold Perlman 
family. 


APPENDIX 


1. Gradient and Hessian for J(e) 


Taking a small variation of the control e ^ e + 5e gives the following expansion for the 
objective J{e) = Tr[H,(T)pof/t(T)0]: 

T T T 

r ^ T } r r T 

J{e + Se) = J(£) -h J dt6e{t)j^ 2 i 7 + o(fe^) 

= J{s) + (V Js, Se) — {Se, H^6e) o(fc^) = J {e) -\- (V J^,6e) -\- —h(^6E) -I- 0(^6e'^) 


where and are the gradient and Hessian of J evaluated at £ and h{6E) = {6 e, H^Se). 
Denoting V{t) = W^{t)VU,{t) and Ot = Ul{T)OU,{T), we may obtain expressions for the 
gradient and Hessian of J: 

6J 




( 4 ) 


Hs{ti, ^ 2 ) — 




fe(fi)fe(f2) 


TT{OT[2V{h)poV{t2) - f[V{t,)V{h)]po - PoTa[H(fi)H(f 2 )]] } , (5) 
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where T and Ta stand for the operators of chronological and anti-chronological ordering, 
respectively. 


2. Second order dynamical traps at KCP 


A DCP £ satishes 
for any t G [0, T]: 


0. Eq. dH) implies that a control held £ is a DCP if and only if 


Tr{[p„,OTlr(i)}=0 


( 6 ) 


If £ is a kinematically critical control, then [pq,Ot] = 0 and the Hessian (jS]) at £ takes the 
form 


= TT{[2V{h)poV{t2) - [V{h)V{t 2 ) + V{t 2 )V{h)]po]OT} 


Then 


^(/) — Tr[£y^(po)Or] 

where Vf = f{t)V{t)dt = Jq f{t)W{t)VU{t)dt and Cvj> is the Lindblad-type snperopera- 
tor of the form 

Cv,{p) = 2VjpVf-V/p-pV/ 

The condition [pq,Ot\ = 0 implies the existence of an orthonormal basis |0fc) snch that 


n 


Ot — X! 0fc)(0A: , 

k=l 

-^max •— -^1 ^ -^2 ^ ^ —• -^min 

(7) 

n 

Po = X! , 

n 

uJk>0, '^Uk = l 

(8) 

k=l 

k=l 


Then at a KCP 



Kf)- 

Tl 

= X! ^kifklOr — Afc /fc) 

fc=i 

(9) 

where \fk) = Vf\(j)k). The expression 

([9]) can be rewritten as: 



h(f)= 

k^i 

and can be represented as the difference of two non-negative qnantities. 





where 


h+(/)= ^ uJk{Xi-Xk)\{cl>k\Vf\cj),)\‘^>0 

l<i<k<n 

h~{f)= Y. ^k{Xk - Xi)\{4>k\Vf\4>i)\‘^ > 0 

n>i>k>l 

If the initial state is po = |0i)(0i|) corresponding to the global maximum of the objective, 
then h{f) = —h~{f) = (/i|Ot — Amax|/i) < 0 and the Hessian is negative semi-dehnite. 
Similarly, if the initial state is po = \4>n){4>n\, corresponding to the global minimum of the 
objective, then h{f) = = {fnlOr — Amin|/n) > 0 and the Hessian is positive semi- 

dehnite. 

If a control held e is a DCP at a KCP and satishes (i) J{e) < JmsLx and (ii) for all i, k 
such that cjfc 7 ^ 0 and Aj > A*,, for all times t G (0, T) 

(0,|H(t)|0fc) = O (10) 


then e: is a second order dynamical trap. Indeed, in this case for any / 


h+(/)= ^ UkiK-Xk) 


dtf{t){(l)i\V{t)\(l)k) 


= 0 


Y ^ 0 

and hence h{f) < 0 for any /. A similar analysis shows that if the condition (ITOll is satished 
for Afc > Aj, then h~{f) = 0 and therefore h{f) > 0 . 

This result leads to the main statement of this work that a control e{t) = Sq is a sec¬ 
ond order dynamical trap if in terms of the spectral decomposition Hq = Hq — p^o = 
initial density matrix and target operator have the form po = \k){k\ and 
O = SILi Ai|i)(i|, where 1 < k < n and Ai > A 2 > ... > A^, and the dipole moment satishes 
{i\fi\k) = 0 for all i < k. Indeed, in this case Ot = O and therefore [po, Ot] = 0. Hence the 
control e{t) = £0 is a KCP. The dipole moment evolves as 


p(t) = 


and therefore for any i < k 


k—1 

h^if) = - ^k)\{i\f^f\~k)\'^ = 0 

2=1 


Hence for any / 




9 


and the Hessian at e(t) = £o is negative semi-definite [h{f) < 0] showing that e(t) = Eq 
is a second order trap. In particnlar, for a 3-level A-system evolving nnder the action of 
zero control £{t) = 0 , (l|/i(t)| 2 ) = = 0 and therefore for any /, h+(/) = 

(A 2 — Ai)|(l|p/|2)p = 0. Thus, for this system e(t) = 0 is a second order trap. 


3. Dynamical critical points not at KCP 


The criterion (E]) can be rewritten in the following equivalent forms (where the spectral 
decomposition po = Y^0Ji\4>i){4>i\ for the initial state is used in the second line) 


^TT[poOTV{t)] = 0 ( 11 ) 

n 

J2uj,^mOTV{t)\cj),)] = 0 ( 12 ) 

i=l 

At a KCP, po and Ot commute. This implies that they have a common basis |0j) such 
that = Aj|0j). Since V{t) is Hermitian, the criterion ffT^ is trivially satisfied, i.e. 

every KCP is a DCP. For DCP that are not at KCP, po and Ot do not commute. Therefore 

at least one eigenvector of Ot is not an eigenvector of po and verification of the criterion flT^ 

becomes more complicated. Nevertheless, as we now show the dynamical landscapes can 
have a critical point - a DCP - when the kinematical landscape does not have a KCP. 

Consider a completely controllable n-level quantum system with the Hamiltonian H = 
Hq — p£{t), where Hq = hi\i){i\. Moreover, consider initial states and target operators 

of the forms 


Po = \^){'4’\, 


K) + 

V2 




i) + 

x/2 


where T is the final time, Q is any Hermitian operator whose kernel contains the vector l"^), 
and a = 0 — "0 7 ^ 0, TT. If pjj = pjj, then the control e{t) = 0 is a DCP that not a KCP. 

To prove this statement, first we show that Z := [po, Ot] 7 ^ 0. In fact, for e{t) = 0 


Ot = + Q 


and therefore 


Z = 


1 -Fe" 


#)( 0 l 


1 + e” 


■|0)(^l 


2 


2 
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where we have used the fact that [|V’)(t/’|, Q] = 0 due to the assumption that vector 1-0) is 
in the kernel of Q. This operator is non-vanishing; for example 

^ 1-1- 1 — COS OL 

= -^- ^0fora^0,7r 

Now we will prove that e{t) = 0 is a critical control. The condition flTTl) takes the form 

^[(^l0)(0l/^(f)lV’)] = 0 Vfe[0,T] (13) 

One has 

Since for our system = fijj, the condition flT^ is satished and therefore £(f) = 0 is a 
non-kinematically critical control. The objective value produced by the control e{t) = 0 is 
J(£ = 0 ) = Tt[poOt] = I (^10)1^ = (1 + cosq;)/ 2 , J^m < 0 <J(£ = 0 )< 1 < Jmax, wliere 
Jmin and Jmax are the minimal and maximal values of the objective. Therefore, the control 
e{t) = 0 is not a global maximum or minimum, but a DCP that is not a KCP. 

Remark 1 The case with Q = 0 corresponding to the problem of optimal population transfer 
between two pure states was considered in 

Remark 2 The condition pa = pjj for some i,j can be consistent with the controllability 
assumption. Moreover, for many physical systems the diagonal matrix elements of the dipole 
moment vanish such that this condition is trivially satisfied. Therefore, this theorem describes 
a class of completely controllable systems which under physically reasonable assumptions 
about the dipole moment have a local DCP that are not at a KCP. 


Remark 3 The theorem can be generalized to constant non-zero controls e{t) = Eq. Let 
Ho := Hq — pEo = hi\i){i\. If for some i ^ j, {i\p\i) = {j\p\j), then the control E{t) = Eq 

i=l 

is non-kinematically critical for any initial state and target operator of the forms 


Po = W')«'i. 

O = e-*^^°(|0)(0|+Q)e*^^°, 


i) -\- 

x/2 


where T is the final time, Q is any Hermitian operator whose kernel contains vector \'if) 
and a = (j) — ip ^ 0,7r. 
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